Papers with probes model
Dynamic Data Selection for Curriculum Learning via Ability Estimation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing curriculum learning methods rely on heuristics to estimate difficulty of data . a major drawback is that they ignore competency of the model during training . |
| Approach: | They propose replacing difficulty heuristics with learned difficulty parameters . they propose a strategy that probes model ability at each training epoch . |
| Outcome: | The proposed strategy outperforms heuristic-based learning models on the GLUE classification tasks. |